C-NIDS Detector - Comprehensive Test Report

Generated: 2026-01-28 15:14:14

Total Test Runs: 13

Sources: Agent Evaluation: 13

Average Accuracy
60.38%
Average F1-Score
75.29%
Zero-Day Detection
5.36%
Test Sources
1

Zero-Day Attack Analysis

Metric Value
Total Zero-Day Samples 2642
Zero-Day Attacks Detected 137
Zero-Day Attacks Missed 2505
Zero-Day False Alarms 35
Overall Detection Rate 5.19%

Performance Assessment

? Overall Performance: NEEDS IMPROVEMENT - Significant enhancement required

Total Detections: TP=7849, TN=0, FP=5151, FN=0

Test Sources: Agent Evaluation: 13

Zero-Day Detection Rate: 5.36%

Test Results Summary

Source Model Date Time Filename Total_Requests Attack_Ratio ZeroDay_Ratio Accuracy F1_Score Precision Recall ZeroDay_Rate ZeroDay_Precision ZeroDay_False_Alarm_Rate TP FP TN FN Total_Samples ZeroDay_Detected ZeroDay_Samples ZeroDay_False_Alarms ZeroDay_Missed Avg_Response_Time Test_Duration
Agent Evaluation Agent_Test 2026-01-28 15:13:43 metrics_20260128_151343.json 1000 1.0 0.193 62.10% 76.62% 62.10% 100.00% 26.42% 89.47% 1.58% 621 379 0 0 1000 51 193 6 142 N/A N/A
Agent Evaluation Agent_Test 2026-01-28 13:51:13 metrics_20260128_135113.json 1000 1.0 0.214 60.70% 75.54% 60.70% 100.00% 21.50% 88.46% 1.53% 607 393 0 0 1000 46 214 6 168 N/A N/A
Agent Evaluation Agent_Test 2026-01-28 13:47:06 metrics_20260128_134706.json 1000 1.0 0.183 58.90% 74.13% 58.90% 100.00% 21.31% 68.42% 4.38% 589 411 0 0 1000 39 183 18 144 N/A N/A
Agent Evaluation Agent_Test 2026-01-28 13:40:18 metrics_20260128_134018.json 1000 1.0 0.214 60.10% 75.08% 60.10% 100.00% 0.00% 0.00% 0.00% 601 399 0 0 1000 0 214 0 214 N/A N/A
Agent Evaluation Agent_Test 2026-01-28 13:10:17 metrics_20260128_131017.json 1000 1.0 0.220 59.40% 74.53% 59.40% 100.00% 0.00% 0.00% 0.25% 594 406 0 0 1000 0 220 1 220 N/A N/A
Agent Evaluation Agent_Test 2026-01-28 12:59:16 metrics_20260128_125916.json 1000 1.0 0.191 60.40% 75.31% 60.40% 100.00% 0.00% 0.00% 0.25% 604 396 0 0 1000 0 191 1 191 N/A N/A
Agent Evaluation Agent_Test 2026-01-28 12:55:10 metrics_20260128_125510.json 1000 1.0 0.210 59.60% 74.69% 59.60% 100.00% 0.00% 0.00% 0.00% 596 404 0 0 1000 0 210 0 210 N/A N/A
Agent Evaluation Agent_Test 2026-01-28 12:08:13 metrics_20260128_120813.json 1000 1.0 0.183 60.50% 75.39% 60.50% 100.00% 0.00% 0.00% 0.25% 605 395 0 0 1000 0 183 1 183 N/A N/A
Agent Evaluation Agent_Test 2026-01-28 12:04:51 metrics_20260128_120451.json 1000 1.0 0.208 60.40% 75.31% 60.40% 100.00% 0.00% 0.00% 0.25% 604 396 0 0 1000 0 208 1 208 N/A N/A
Agent Evaluation Agent_Test 2026-01-28 12:01:00 metrics_20260128_120100.json 1000 1.0 0.232 62.60% 77.00% 62.60% 100.00% 0.00% 0.00% 0.00% 626 374 0 0 1000 0 232 0 232 N/A N/A
Agent Evaluation Agent_Test 2026-01-28 11:57:39 metrics_20260128_115739.json 1000 1.0 0.188 61.50% 76.16% 61.50% 100.00% 0.00% 0.00% 0.00% 615 385 0 0 1000 0 188 0 188 N/A N/A
Agent Evaluation Agent_Test 2026-01-28 11:54:07 metrics_20260128_115407.json 1000 1.0 0.203 59.20% 74.37% 59.20% 100.00% 0.00% 0.00% 0.00% 592 408 0 0 1000 0 203 0 203 N/A N/A
Agent Evaluation Agent_Test 2026-01-28 11:49:24 metrics_20260128_114924.json 1000 1.0 0.203 59.50% 74.61% 59.50% 100.00% 0.49% 50.00% 0.25% 595 405 0 0 1000 1 203 1 202 N/A N/A

Detailed Report

================================================================================
C-NIDS DETECTOR - COMPREHENSIVE TEST REPORT
================================================================================
Report Generated: 2026-01-28 15:14:13
Total Test Runs: 13
Sources: 1 (Agent Evaluation)
================================================================================

OVERALL STATISTICS BY SOURCE:
----------------------------------------

Agent Evaluation:
  Total Runs: 13
  Average Accuracy: 60.38%
  Average F1-Score: 75.29%
  Average Zero-Day Detection Rate: 5.36%
  Average Zero-Day Precision: 22.80%


OVERALL STATISTICS:
----------------------------------------
Overall Average Accuracy: 60.38%
Overall Average F1-Score: 75.29%
Overall Zero-Day Detection Rate: 5.36%
Overall Zero-Day Precision: 22.80%


ZERO-DAY ATTACK ANALYSIS:
----------------------------------------
Total Zero-Day Samples: 2642
Zero-Day Attacks Detected: 137
Zero-Day Attacks Missed: 2505
Zero-Day False Alarms: 35
Overall Zero-Day Detection Rate: 5.19%
Zero-Day False Alarm Rate: 0.68%

TOTAL DETECTION COUNTS:
----------------------------------------
  True Positives:  7849
  True Negatives:  0
  False Positives: 5151
  False Negatives: 0


PER MODEL STATISTICS:
----------------------------------------

Agent_Test:
  Source:            Agent Evaluation
  Latest Accuracy:   62.10%
  Latest F1-Score:   76.62%
  Zero-Day Rate:     5.36%
  Average Accuracy:  60.38%
  Average F1-Score:  75.29%
  Test Date:         2026-01-28
  Latest Performance: FAIR


RECOMMENDATIONS:
----------------------------------------
?? Fair performance, room for improvement
  - Investigate high false positive/negative rates
  - Consider adding more training data
  - Review feature selection
  - Zero-day detection requires significant attention

? ZERO-DAY DETECTION CRITICAL ISSUES:
  - Implement additional anomaly detection techniques
  - Consider unsupervised learning approaches
  - Increase zero-day training scenarios
  - Review zero-day detection thresholds

================================================================================
END OF REPORT
================================================================================